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HILBERT  SPACE 


Probably  the  most  useful  and  certainly  the  best  developed  generalization 
of  the  theory  of  finite-dimensional  inner  product  spaces  is  the  theory  of 
Hilbert  space.  Without  going  into  details  and  entirely  without  proofs 
we  shall  now  attempt  to  indicate  how  this  generalization  proceeds  and 
what  are  the  main  difficulties  that  have  to  be  overcome. 

The  definition  of  Hilbert  space  is  easy :  it  is  an  inner  product  space  satisfy¬ 
ing  one  extra  condition.  That  this  condition  (namely,  completeness)  is 
automatically  satisfied  in  the  finite-dimensional  case  is  proved  in  ele¬ 
mentary  analysis.  In  the  infinite-dimensional  case  it  may  be  possible  that 
for  a  sequence  (xn)  of  vectors  \\  xn  —  xm\\  — »  0  as  n,  m  — >  oo,  but  still 
there  is  no  vector  x  for  which  jj  xn  —  x  ||  — >  0;  the  only  effective  way  of 
ruling  out  this  possibility  is  explicitly  to  assume  its  opposite.  In  other 
words:  a  Hilbert  space  is  a  complete  inner  product  space.  (Sometimes  the 
concept  of  Hilbert  space  is  restricted  by  additional  conditions,  whose 
purpose  is  to  limit  the  size  of  the  space  from  both  above  and  below.  The 
most  usual  conditions  require  that  the  space  be  infinite-dimensional  and 
separable.  In  recent  years,  ever  since  the  realization  that  such  additional 
restrictions  do  not  pay  for  themselves  in  results,  it  has  become  customary 
to  use  “Hilbert  space”  for  the  concept  we  defined.) 

It  is  easy  to  see  that  the  space  (P  of  polynomials  with  the  inner  product 

defined  by  (x,  y )  =  r  x(t)y(t)  dt  is  not  complete.  In  connection  with  the 

completeness  of  certain  particular  Hilbert  spaces  there  is  quite  an  extensive 
mathematical  lore.  Thus,  for  instance,  the  main  assertion  of  the  celebrated 
Riesz-Fischer  theorem  is  that  a  Hilbert  space  manufactured  out  of  the 

set  of  all  those  functions  x  for  which  J*  |  x(t)  |2  dt  <  <*>  (in  the  sense  of 

Lebesgue  integration)  is  a  Hilbert  space  (with  formally  the  same  definition 
of  inner  product  as  for  polynomials).  Another  popular  Hilbert  space, 
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reminiscent  in  its  appearance  of  finite-dimensional  coordinate  space,  is 
the  space  of  all  those  sequences  (£n)  of  numbers  (real  or  complex,  as  the 
case  may  be)  for  which  |  £n  |2  converges. 

Using  completeness  in  order  to  discuss  intelligently  the  convergence  of 
some  infinite  sums,  one  can  proceed  for  quite  some  time  in  building  the 
theory  of  Hilbert  spaces  without  meeting  any  difficulties  due  to  infinite- 
dimensionality.  Thus,  for  instance,  the  notions  of  orthogonality  and  of 
complete  orthonormal  sets  can  be  defined  in  the  general  case  exactly  as  we 
defined  them.  Our  proof  of  Bessel's  inequality  and  of  the  equivalence  of 
the  various  possible  formulations  of  completeness  for  orthonormal  sets 
have  to  undergo  slight  verbal  changes  only.  (The  convergence  of  the 
various  infinite  sums  that  enter  is  an  automatic  consequence  of  Bessel's 
inequality.)  Our  proof  of  Schwarz's  inequality  is  valid,  as  it  stands,  in 
the  most  general  case.  Finally,  the  proof  of  the  existence  of  complete 
orthonormal  sets  parallels  closely  the  proof  in  the  finite  case.  In  the 
unconstructive  proof  Zorn's  lemma  (or  transfinite  induction)  replaces 
ordinary  induction,  and  even  the  constructive  steps  of  the  Gram-Schmidt 
process  are  easily  carried  out. 

In  the  discussion  of  manifolds,  functionals,  and  transformations  the 
situation  becomes  uncomfortable  if  we  do  not  make  a  concession  to  the 
topology  of  Hilbert  space.  Good  generalizations  of  all  our  statements  for 
the  finite-dimensional  case  can  be  proved  if  we  consider  closed  linear 
manifolds,  continuous  linear  functionals,  and  bounded  linear  transformations. 
(In  a  finite-dimensional  space  every  linear  manifold  is  closed,  every  linear 
functional  is  continuous,  and  every  linear  transformation  is  bounded.)  If, 
however,  we  do  agree  to  make  these  concessions,  then  once  more  we  can 
coast  on  our  finite-dimensional  proofs  without  any  change  most  of  the 
time,  and  with  only  the  insertion  of  an  occasional  e  the  rest  of  the  time. 
Thus  once  more  we  obtain  that  *0  =  9TI  ®  9H"1,  that  2fTl  =  2HX  J"L,  and  that 
every  linear  functional  of  x  has  the  form  (x,  y) ;  our  definitions  of  self- 
adjoint  and  of  positive  transformations  still  make  sense,  and  all  our  theo¬ 
rems  about  perpendicular  projections  (as  well  as  their  proofs)  carry  over 
without  change. 

The  first  hint  of  how  things  can  go  wrong  comes  from  the  study  of  orthog¬ 
onal  and  unitary  transformations.  We  still  call  a  transformation  U 
orthogonal  or  unitary  (according  as  the  space  is  real  or  complex)  if  UU* 
=  U*U  =  1,  and  it  is  still  true  that  such  a  transformation  is  isometric, 
that  is,  that  ||  Ux  ||  =  ||  x  ||  for  all  x,  or,  equivalently,  (C7x,  Uy)  =  (x,  y) 
for  all  x  and  y .  It  is,  however,  easy  to  construct  an  isometric  transforma¬ 
tion  that  is  not  unitary;  because  of  its  importance  in  the  construction  of 
counterexamples  we  shall  describe  one  such  transformation.  We  consider 
a  Hilbert  space  in  which  there  is  a  countable  complete  orthonormal  set, 
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say  {z0,  xiy  x2,  *•*}•  A  unique  bounded  linear  transformation  U  is 
defined  by  the  conditions  Uxn  =  xn+i  for  n  —  0,  1,  2,  •  •  •  .  This  U  is 
isometric  (U*U  =  1),  but,  since  UU*x 0  =  0,  it  is  not  true  that  UU*  =  1. 

It  is  when  we  come  to  spectral  theory  that  the  whole  flavor  of  the  develop¬ 
ment  changes  radically.  The  definition  of  proper  value  as  a  number  X 
for  which  Ax  —  \x  has  a  non-zero  solution  still  makes  sense,  and  our  theo¬ 
rem  about  the  reality  of  the  proper  values  of  a  self-adjoint  transformation 
is  still  true.  The  notion  of  proper  value  loses,  however,  much  of  its  sig¬ 
nificance.  Proper  values  are  so  very  useful  in  the  finite-dimensional  case 
because  they  are  a  handy  way  of  describing  the  fact  that  something  goes 
wrong  with  the  inverse  of  A  —  X,  and  the  only  thing  that  can  go  wrong  is 
that  the  inverse  refuses  to  exist.  Essentially  different  things  can  happen 
in  the  infinite-dimensional  case;  just  to  illustrate  the  possibilities,  we 
mention,  for  example,  that  the  inverse  of  A  —  X  may  exist  but  be  un¬ 
bounded.  That  there  is  no  useful  generalization  of  determinant,  and 
hence  of  the  characteristic  equation,  is  the  least  of  our  worries.  The 
whole  theory  has,  in  fact,  attained  its  full  beauty  and  maturity  only  after 
the  slavish  imitation  of  such  finite-dimensional  methods  was  given  up. 

After  some  appreciation  of  the  fact  that  the  infinite-dimensional  case 
has  to  overcome  great  difficulties,  it  comes  as  a  pleasant  surprise  that  the 
spectral  theorem  for  self-adjoint  transformations  (and,  in  the  complex 
case,  even  for  normal  ones)  does  have  a  very  beautiful  and  powerful 
generalization.  (Although  we  describe  the  theorem  for  bounded  trans¬ 
formations  only,  there  is  a  large  class  of  unbounded  ones  for  which  it  is 
valid.)  In  order  to  be  able  to  understand  the  analogy,  let  us  re-examine 
the  finite-dimensional  case. 

Let  A  be  a  self-adjoint  linear  transformation  on  a  finite-dimensional 
inner  product  space,  and  let  A  =  M'i  be  its  spectral  form.  If  M  is 
an  interval  in  the  real  axis,  we  write  E{M)  for  the  sum  of  all  those  Fj  for 
which  \j  belongs  to  M.  It  is  clear  that  E(M)  is  a  perpendicular  projection 
for  each  M .  The  following  properties  of  the  projection-valued  interval- 
function  E  are  the  crucial  ones:  if  M  is  the  union  of  a  countable  collection 
{Mn}  of  disjoint  intervals,  then 

(1)  E(M)  =  Zn  E(Mn] ), 

and  if  M  is  the  improper  interval  consisting  of  all  real  numbers,  then 
E(M)  —  1.  The  relation  between  A  and  E  is  described  by  the  equation 

A  =  2 A, •£({*;}), 

where,  of  course,  {Xy}  is  the  degenerate  interval  consisting  of  the  single 
number  Xy.  Those  familiar  with  Lebesgue-Stieltjes  integration  will  recog¬ 
nize  the  last  written  sum  as  a  typical  approximating  sum  to  an  integral  of 
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the  form  J  X  dE(\)  and  will  therefore  see  how  one  may  expect  the  general¬ 
ization  to  go.  The  algebraic  concept  of  summation  is  to  be  replaced  by 
the  analytic  concept  of  integration;  the  generalized  relation  between  A  and 
E  is  described  by  the  equation 

(2)  A  =  JxdE(X). 

Except  for  this  formal  alteration,  the  spectral  theorem  for  self-adjoint 
transformations  is  true  in  Hilbert  space.  We  have,  of  course,  to  interpret 
correctly  the  meaning  of  the  limiting  operations  involved  in  (1)  and  (2). 
Once  more  we  are  faced  with  the  three  possibilities  mentioned  in  §  91. 
They  are  called  uniform,  strong,  and  weak  convergence  respectively,  and 
it  turns  out  that  both  (1)  and  (2)  may  be  given  the  strong  interpretation. 
(The  reader  deduces,  of  course,  from  our  language  that  in  an  infinite-di¬ 
mensional  Hilbert  space  the  three  possibilities  are  indeed  distinct.) 

We  have  seen  that  the  projections  Fj  entering  into  the  spectral  form  of  A 
in  the  finite-dimensional  case  are  very  simple  functions  of  A  (§  82).  Since 
the  E(M)  are  obtained  from  the  Fj  by  summation,  they  also  are  functions 
of  A,  and  it  is  quite  easy  to  describe  what  functions.  We  write  gMiX)  = 

1  if  f  is  in  M  and  0m  (f)  =  0  otherwise;  then  E(M)  =  0m 04.).  This  fact 
gives  the  main  clue  to  a  possible  proof  of  the  general  spectral  theorem. 
The  usual  process  is  to  discuss  the  functional  calculus  for  polynomials, 
and,  by  limiting  processes,  to  extend  it  to  a  class  of  functions  that  includes 
all  the  functions  0m  •  Once  this  is  done,  we  may  define  the  interval- 
function  E  by  writing  E{M)  =  qm (A);  there  is  no  particular  difficulty  in 
establishing  that  E  and  A  satisfy  (1)  and  (2). 

After  the  spectral  theorem  is  proved,  it  is  easy  to  deduce  from  it  the 
ge  neralized  versions  of  our  theorems  concerning  square  roots,  the  functional 
ca  leulus,  the  polar  decomposition,  and  properties  of  commutativity,  and, 
in  fact,  to  answer  practically  eveiy  askable  question  about  bounded  normal 
tr  ansformations. 

The  chief  difficulties  that  remain  are  the  considerations  of  non-normal 
an  d  of  unbounded  transformations.  Concerning  general  non-normal  trans- 
formations,  it  is  quite  easy  to  describe  the  state  of  our  knowledge;  it  is 
non-existent.  No  even  unsatisfactory  generalization  exists  for  the  tri- 
ngular  form  or  for  the  Jordan  canonical  form  and  the  theory  of  elementary 
ivisors.  Very  different  is  the  situation  concerning  normal  (and  par- 
icularly  self-adjoint)  unbounded  transformations.  (The  reader  will 
ympathize  with  the  desire  to  treat  such  transformations  if  he  recalls 
hat  the  first  and  most  important  functional  operation  that  most  of  us 
earn  is  differentiation.)  In  this  connection  we  shall  barely  hint  at  the 
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main  obstacle  the  theory  faces.  It  is  not  very  difficult  to  show  that 
if  a  self-adjoint  linear  transformation  is  defined  for  all  vectors  of  Hilbert 
space,  then  it  is  bounded.  In  other  words,  the  first  requirement  con¬ 
cerning  transformations  that  we  are  forced  to  give  up  is  that  they  be  de¬ 
fined  everywhere.  The  discussion  of  the  precise  domain  on  which  a  self- 
adjoint  transformation  may  be  defined  and  of  the  extent  to  which  this 
domain  may  be  enlarged  is  the  chief  new  difficulty  encountered  in  the 
study  of  unbounded  transformations. 


RECOMMENDED  READING 


The  following  very  short  list  makes  no  pretense  to  completeness;  it  merely 
contains  a  couple  of  representatives  of  each  of  several  directions  in  which  the 
reader  may  want  to  proceed. 

For  generalized  (but  usually  finite-dimensional)  linear  and  multilinear  algebra: 

1.  N.  Bourbaki,  Algebre;  Chap.  II  {Algbbre  Unfair e),  Paris,  1947,  and  Chap.  Ill 
(Alg&bre  midtilineaire) ,  Paris,  1948. 

2.  B.  L.  van  deb  Waerden,  Modem  algebra ,  New  York,  1953. 

For  connections  with  classical  and  modern  analysis: 

1.  S.  Banach,  Theorie  des  operations  linfaires ,  Warszawa,  1932. 

2.  F.  Riesz  and  B.  Sz.-Nagy,  Functional  analysis ,  New  York,  1955. 

For  the  geometry  of  Hilbert  space  and  transformations  on  it: 

1.  P.  R.  Halmos,  Introduction  to  Hilbert  space ,  New  York,  1951. 

2.  M.  H.  Stone,  Linear  transformations  in  Hilbert  space,  New  York,  1932. 

For  contact  with  classical  and  modern  physics: 

1.  R.  Courant  and  D.  Hilbert,  Methods  of  mathematical  physics ,  New  York,  1953. 

2.  J.  von  Neumann,  Mathematical  foundations  of  quantum  mechanics,  Princeton, 
1955. 
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Adjoint,  79,  86 
Algebraically  closed,  104 
Alternating  form,  50 
group,  47 
Annihilator,  26 
Automorphism,  86 

Basis,  10 

Bessel's  inequality,  124 
Bilinear  form,  36 
functional,  21,  36 
Bounded  from  below,  177 
transformation,  176 

Cartesian  decomposition,  136 
Cayley  transform,  145 
Characteristic  equation,  polynomial, 
root,  101 
of  a  field,  2 

Classical  canonical  form,  114 
Cogredient,  83 
Column,  65 
rank,  91 

Complement,  18 
Complete  metric  space,  176,  189 
orthonormal  set,  122 
Complexification,  41,  151 
Complex  vector  space,  4 
Congruent  vectors,  35 
transformations,  134 
Conjugate  bilinear  form  122 
isomorphism,  131 
permutations,  46 
Conjugation,  145 
Contragredient,  83 
Contravariant,  83 
Convergence,  175,  183 
Convex,  162 


Coordinate  space,  4,  5 
system,  10 
Coset,  33 
Covariant,  83 
Cycle,  44 

Degenerate,  37 

Determinant,  99 
Diagonable,  108 
Diagonal  form,  108 
Dimension,  14 
Direct  sum,  28 
Disjoint  cycles,  44 
subspaces,  17 
Dual  basis,  23 
space,  21 

Elementary  divisor,  114 
Equivalence  relation,  35 
Equivalent,  87 
Ergodic  theorem,  185 
Euclidean  space,  121 
Even  permutation,  47 
polynomial,  19 
External  direct  sum,  30 
Extreme  point,  162 

Field,  2 

Finite-dimensional  vector  space,  10 
Gramian,  142 

Gram-Schmidt  orthogonalization  proc¬ 
ess,  128 
Graph,  134 
Group,  44 

Hadamard  product,  174 
Hamilton-Cayley  equation,  115 


198 


INDEX  OF  TERMS 


Hermitian  symmetry,  122 
transformation,  135 
Hilbert  space,  189 
Hochschild,  G.  P.,  198 
Homogeneous  functional,  20 
transformation,  55 

Idempotent,  73 
Identity,  43 
Image,  88 

Imaginary  part  of  a  complex  number,  126 
part  of  a  transformation,  137 
Independent,  32 
Index,  109 
Infimum,  176 
Inner  product,  119,  121 
product  space,  121 
Intersection,  17 
Internal  direct  sum,  30 
Invariant,  71 

Inverse  of  a  permutation,  43 
of  a  transformation,  62 
Invertible,  62 
Involution,  78 
Isometric  matrix,  144 
Isometry,  143 
Isomorphism,  14 

Jordan  form,  114 

Kronecker  product,  98 

Lattice,  142 
Law  of  nullity,  92 
Left  inverse,  64 
Length,  121 
Linear  combination,  9 
dependence,  7 
functional,  20 
independence,  7 
manifold,  16 
transformation,  55,  57 
Lower  bound,  180 

Matrix,  65 

Minimal  polynomial,  114 
Minimax  principle,  181 
Module,  5 

Multilinear  form,  48 
Multiplicity,  103 
algebraic,  104 


Multiplicity  (Cont.) : 
geometric,  104 
of  elementary  divisors,  114 

Neumann  series,  186 
Nilpotent,  109 
Non-degenerate,  37 
Non-singular,  99 
Norm,  121 

of  a  linear  transformation,  176 
Normal,  159 

Normed  vector  space,  126 
Nullity,  90 
Null-space,  88 
Numerical  range,  162 

Odd  permutation,  47 
polynomial,  19 
Operator,  55 

Order  of  a  permutation,  46 
Origin,  3 

Orthogonal  vectors,  122 
complement,  123 
dimension,  122 
equivalence,  158 
projections,  147 
transformation,  142 
Orthonormal,  122 
basis,  128 

Parity,  47 

Parseval’s  identity,  124 
Partial  isometry,  150 
Permutation,  42 
Perpendicular  projection,  146 
Polar  decomposition,  170 
Polarization,  138 
Positive  definite  form,  122 
transformation,  140 
matrix,  141 
number,  2 
Principal  minor,  167 
Product  of  linear  transformations,  58 
of  permutations,  42 
Projection,  73 
Proper  value,  102 
vector,  102 

Quadratic  form,  38 
Quotient  space,  34 
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Range,  88 
Rank,  90 

Rational  vector  space,  4 
Real  part  of  a  complex  number,  126 
part  of  a  transformation,  137 
transformation,  137 
vector  space,  4 
Reducibility,  72 
Reflexivity,  25,  28 
Riesz-Fischer  theorem,  189 
Right  inverse,  64 
Row,  65 
rank,  91 

Scalar,  1 
product,  119 

Schwarz's  inequality,  125 
Self-adjoint,  135 
Signum,  47 
Similar,  85 

Simple  elementary  divisor,  114 
proper  value,  103 
Singular,  99 
Skew  Hermitian,  136 
-symmetric  form,  50 
-symmetric  transformation,  136 
Span,  17 

Spectral  form,  156 
radius,  182 
theorem,  156 


Spectrum,  103 
Strictly  positive,  140 
Subgroup,  47 
Subspace,  16 
Supremum,  176 
Sylvester's  law  of  nullity,  92 
Symmetric  bilinear  form,  38 
form,  49 
group,  44 

transformation,  135 

Tensor  product  of  spaces,  40 
product  of  transformations,  95 
Trace,  105,  109 
Transpose,  81 
Transposition,  44 
Triangular  form,  107 

Unitary  equivalence,  158 
space,  121 
transformation,  142 
Upper  bound,  180 

Vector,  3 

space,  3 

Well-ordering,  13 
Zorn’s  lemma,  13 
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«*,  47 
[A],  65 
A~\  62 
A',  79 
[A;  SC],  65 
A*,  132 
A+,  151 
II  A  ||,  176 

e,  2 
en,  4 

5,  10 
det,  99 
dim,  19 

Sx,  123 
«,  43 

exp  A,  186 
3*  5 


Q,2 

<R,  2 

<R(A),  88 
r(A),  182 
Re,  126 
p(A),  90 
<Rn,  5 

S°,  26 
sgn,  47 
Si,  43 
sup,  176 

tr,  105 

D',  20 
13",  24 
i3/9ii,  34 
13+  41,  151 
1)*,  131 


3C  +  3C,  18 

Im,  126 
inf,  176 

91100,  27 

91(A),  88 
v(A),  90 

0,  5 

<P,  4 
x— l,  43 
Pm,  146 
(P»,  5 
(P,  «),  44 


[a:,  2/1,  21 
<*,  2/),  28 
X',  23 
x  +  9TC,  33 
(x,  y),  119,  121 

II  *  II,  H8,  121 


Zm,  2 


C,  17 
n,  17 
0,28 
®,  40,  95 
=,  35 
140 

{•••:•••},  176 


